Select: Choose Columns
The previous session covered the basics of select but
there are many more options for how we can specify which columns to
choose.
First, let’s remember what the column names are:
names(police)
Recall, the select function takes as the first input a
data frame, and then we can list one or more columns, names unquoted,
that we want to select. The columns will be ordered in the order we
specify them. Notice that the order in the output is different than the
original order above.
police %>% select(outcome, date)
select(police, outcome, date)
Ranges
There are a number of select helper functions and special syntax
options that allow us to choose multiple columns.
First, we can use : for range, but with names in addition to
numbers:
police %>% select(raw_DriverRace:raw_ResultOfStop)
The result is the same if we use numbers.
police %>% select(26:29)
We can select the rightmost columns with last_col(). You
can check with names that it is the “last” column in our
dataset.
police %>% select(last_col())
You can use this to count columns from the right:
select(police, last_col(offset=3))
This is one of the few places R acts like it’s counting from 0,
that’s because it’s the number of columns to offset from the end:
# these are the same
select(police, last_col(0)) %>% names()
select(police, last_col()) %>% names()
EXERCISE
Select just the first 6 columns of police.
Excluding columns
We can also say which columns we don’t want by putting a
- (minus) in front of the name. Think about it as
subtracting one or more columns. The idea of subtracting makes a lot of
sense – after the command below, we have now 27 rather than the original
29 columns in the data.
police %>% select(-raw_row_number, -subject_age)
When using negated - column names, if we start with
negations and try to mix in columns we want to keep, it will get messy.
Make sure to avoid the following code:
police %>% select(-raw_row_number, -subject_age, time:outcome)
To both specify the columns wanted and exclude some that would
otherwise be selected, the exclusions need to come at the end:
police %>% select(time:outcome, -subject_age)
We don’t need to include -raw_row_number – it is not part of the
range between time and outcome. If we do include it, we will still get
the same result.
police %>% select(time:outcome, -subject_age, -raw_row_number)
EXERCISE
Drop the last 4 columns from police (temporarily - write
an expression that will give you police with those columns not
included).
Reordering and renaming
We’ve already seen that columns will appear in the result in the
order that we list the names.
If we list a column name more than once, it will appear in the first
position only (it won’t be repeated):
select(police, date, time, location, date)
If you want to pull a few columns over to the left so that they are
the ones that show first when you look at the data, the everything()
helper function can be useful.
select(police, outcome, everything())
We can also rename columns while using select(). The
syntax is new_name = old_name.
police %>% select(raw_id=raw_row_number, date, time)
or we can use rename() to only rename, without affecting
which columns are included or their order (all of the columns are kept
in the same order):
police %>% rename(raw_id=raw_row_number)
Remember, this doesn’t change police because we didn’t save the
result. So far, we’ve just been printing the copy of the data frame that
is returned by the function. If we want to change our data frame, we’d
need to save the result back to the police object. We can
also save the changes in another object with a different name such as
police_new.
EXERCISES
Remember: run the cells above to load tidyverse and import the
data.
Using select and/or rename as needed:
- Rename subject_age to age, subject_race to race, and subject_sex to
sex, but keep the columns in their original order
- Exclude the department_id and department_name columns
Hint:
- Remember that you can chain dplyr commands together with
%>%
- You don’t need to save the results in a new variable
Matching names
We can also select by matching patterns in the names of the columns.
The patterns to match are in quotes because they aren’t column names –
just character data.
police %>% select(starts_with("contraband"))
police %>% select(ends_with("issued"))
police %>% select(contains("vehicle"))
We can also put a - in front of these helper functions
to exclude columns:
police %>% select(-contains("subject"))
And there are even more select
helper functions.
EXERCISE
Use select() to get a copy of police
without the columns that start with “raw”.
In other words, drop the columns that start with “raw”, except 1)
don’t permanently change police and 2) instead of dropping,
we’re really selecting what we want to keep instead.
Selecting with Vectors or Functions
What if we have the names of the columns we want to select in a
vector already? For example:
analysis_vars <- c("search_basis", "reason_for_stop")
Perhaps we built this vector programatically (we wrote code to
determine the values, instead of typing them ourselves), so we can’t
just rewrite it to:
police %>% select(search_basis, reason_for_stop)
If we just give the vector to select, it looks like we
expect “analysis_vars” to be a column name in police. We get a
warning:
police %>% select(analysis_vars)
This warning tells us what we should do instead, which is use
all_of:
police %>% select(all_of(analysis_vars))
This makes it clearer that “analysis_vars” isn’t the name of a column
in police.
What if we want to select columns of a certain type – for example,
only the numeric columns?
police %>% select(where(is.numeric))
is.numeric is the name of a function. We just use the
name without (). This function is applied to each column,
and if it returns TRUE, then the column is selected. Like above with
using a vector, we wrap the function we want to use in
where to make it clear that we’re using a function, not
looking for a column named “is.numeric”).
where can be used with any function that returns a
single TRUE or FALSE value for each column.
EXERCISE
Select columns with logical (TRUE/FALSE) data from police:
Combining multiple select conditions
What if we want to combine multiple select conditions? For example,
select columns from police that contain “vehicle” and are character
data?
We can use & and |
select(police, contains("vehicle"))
select(police, contains("vehicle") & where(is.character))
Filter: Choose Rows
The filter() function lets us choose which rows of data
to keep by writing expressions that return TRUE or FALSE for every row
in the data frame. Recall:
police %>% filter(date == "2017-01-02")
filter(police, date == "2017-01-02")
We can do complex conditions as we could do with []
police %>% filter(subject_race == "hispanic" & subject_sex == "female")
If we include multiple comma-separated conditions, they are joined
with & (and). So this following is equivalent to the
above.
police %>% filter(subject_race == "hispanic", subject_sex == "female")
EXERCISES
- Filter
police to choose the rows where location is
60201 or 60202
- Filter
police to choose the rows where location is
60201 or 60202, and subject_sex is “male”
Hints:
- The “or” operator is
|; the “and” operator is
&
EXERCISE
Using police: find observations that are not moving
violations. The violation variable has a few categories. Take a
look:
table(police$violation)
Write code to find stops that don’t start with “Moving
Violation”.
str_detect() is a useful function for this. Example:
police %>%
filter(str_detect(subject_race, "w"))
Now find the stops that are NOT moving violations:
Bonus: slice variants
Last session, we saw slice() briefly as a way to choose
which rows we want by their integer index value. But, there are some
useful variants on the slice function that help us select
rows that have the maximum or minimum value of a particular
variable:
mtcars %>% slice_max(hp)
slice_max(mtcars, hp)
By default it just gives us one maximum value (all rows that have
that value though), but we can ask for more than one highest value by
setting the n argument:
slice_max(mtcars, hp, n=3)
We got 4 rows above because there was a tie at position 3. There’s an
option with_ties that can change how ties are handled.
There’s also a minimum version:
slice_min(mtcars, disp)
Like we did with slice_max, you can also specify the
n argument.
EXERCISE
Find the 2 cars with the best mpg values in mtcars (high values are
better).
Then, looking only at cars with 4 cylinders, find the 2 with the best
mpg values.
Mutate: Change or Create Columns
mutate() is used to both change the values of an
existing column and make a new column.
We name the column we’re mutating and set the value. If the name
already exists, it will update the column. If the name doesn’t exist, it
will create a new variable (column is appended at the end of existing
columns).
police %>%
mutate(vehicle_age = 2017 - vehicle_year) %>%
select(starts_with("vehicle")) # just to pick a few columns to look at
We can put multiple mutations in the same call to mutate, with the
expressions separated by commas:
mutate(police,
vehicle_age = 2017 - vehicle_year,
old_car = vehicle_year < 2000)
Within a call to mutate, we can refer to variables we made or changed
earlier in the same call as well. Here, we create vehicle_age, and then
use it to create vehicle_age_norm:
police %>%
mutate(vehicle_age = 2017 - vehicle_year,
vehicle_age_norm = ifelse(vehicle_age < 0, # ifelse test condition
0, # value if true
vehicle_age) # value if false
) %>%
# below is just making it easier for us to see what we changed
select(starts_with("vehicle")) %>%
filter(vehicle_age < 0)
Side note: there is a tidyverse version of ifelse()
called if_else() – with the underscore or low dash symbol –
that works generally the same except it is stricter about checking data
types.
mutate() can also change an existing column. It will
overwrite it.
police %>%
mutate(department_id = "EPD")
We didn’t save the output, so the column hasn’t changed permanently -
only in the output.
police
Remember that when using mutate(), you’re operating on
the entire column at once, so you can’t select just a subset of the
vector as you would with []. This means more frequently
using functions like ifelse() or helper functions such as
na_if(), replace_na(), or
recode().
na_if replaces an existing value with NA.
replace_na does roughly the opposite: replaces
NA with a new value.
police %>% mutate(vehicle_make = na_if(vehicle_make, "UNK"))
na_if() can only can check and replace one value at a
time; it also can’t be used with any expressions
(x <= 1) – only single values.
EXERCISE
If the column beat in police is “/” or “CHICAGO”, set it
to NA instead using mutate().
Hint: it’s ok if you take two steps to do this.
LS0tCnRpdGxlOiAnZHBseXI6IHNlbGVjdCwgZmlsdGVyLCBtdXRhdGUnCm91dHB1dDoKICBodG1sX2RvY3VtZW50OgogICAgZGZfcHJpbnQ6IHBhZ2VkCiAgICBjb2RlX2Rvd25sb2FkOiBUUlVFCiAgICB0b2M6IHRydWUKICAgIHRvY19kZXB0aDogMgplZGl0b3Jfb3B0aW9uczoKICBjaHVua19vdXRwdXRfdHlwZTogY29uc29sZQotLS0KCmBgYHtyLCBzZXR1cCwgaW5jbHVkZT1GQUxTRX0KIyB5b3UgZG9uJ3QgbmVlZCB0byBydW4gdGhpcyB3aGVuIHdvcmtpbmcgaW4gUlN0dWRpbwprbml0cjo6b3B0c19jaHVuayRzZXQoZXZhbD1GQUxTRSkgICMgd2hlbiBtYWtpbmcgdGhlIGh0bWwgdmVyc2lvbiBvZiB0aGlzIGZpbGUsIGRvbid0IGV4ZWN1dGUgdGhlIGNvZGUKYGBgCgpUaGlzIGlzIGFuIFtSIE1hcmtkb3duXShodHRwczovL3JtYXJrZG93bi5yc3R1ZGlvLmNvbS8pIGRvY3VtZW50LiAgRm9sbG93IHRoZSBsaW5rIHRvIGxlYXJuIG1vcmUgYWJvdXQgUiBNYXJrZG93biBhbmQgdGhlIG5vdGVib29rIGZvcm1hdCB1c2VkIGR1cmluZyB0aGUgd29ya3Nob3AuCgojIFNldHVwCgpgYGB7ciwgZXZhbD1UfQpsaWJyYXJ5KHRpZHl2ZXJzZSkKYGBgCgoKVGhlIGRhdGEgaXMgZnJvbSB0aGUgW1N0YW5mb3JkIE9wZW4gUG9saWNpbmcgUHJvamVjdF0oaHR0cHM6Ly9vcGVucG9saWNpbmcuc3RhbmZvcmQuZWR1L2RhdGEvKSBhbmQgaW5jbHVkZXMgdmVoaWNsZSBzdG9wcyBieSB0aGUgRXZhbnN0b24gcG9saWNlIGluIDIwMTcuICBXZSdyZSByZWFkaW5nIHRoZSBkYXRhIGluIGZyb20gYSBVUkwgZGlyZWN0bHkuICAKCmBgYHtyLCBldmFsPVRSVUV9CnBvbGljZSA8LSByZWFkX2NzdigiaHR0cHM6Ly9yYXcuZ2l0aHVidXNlcmNvbnRlbnQuY29tL251aXRyY3Mvci10aWR5dmVyc2UvbWFpbi9kYXRhL2V2X3BvbGljZS5jc3YiLAogICAgICAgICAgICAgICAgICAgY29sX3R5cGVzPWMoICJsb2NhdGlvbiI9ImMiKSkKYGBgCgoKVGhpcyBmaWxlIGdvZXMgaW50byBtb3JlIGRldGFpbCBvbiB0aGUgc2VsZWN0IGFuZCBmaWx0ZXIgZnVuY3Rpb25zIHdlIHRhbGtlZCBhYm91dCBiZWZvcmUsIGFuZCBhZGRzIGluIG11dGF0ZSBmb3IgY2hhbmdpbmcgdmFyaWFibGVzIG9yIG1ha2luZyBuZXcgb25lcy4gIAoKCiMgU2VsZWN0OiBDaG9vc2UgQ29sdW1ucwoKVGhlIHByZXZpb3VzIHNlc3Npb24gY292ZXJlZCB0aGUgYmFzaWNzIG9mIGBzZWxlY3RgIGJ1dCB0aGVyZSBhcmUgbWFueSBtb3JlIG9wdGlvbnMgZm9yIGhvdyB3ZSBjYW4gc3BlY2lmeSB3aGljaCBjb2x1bW5zIHRvIGNob29zZS4KCkZpcnN0LCBsZXQncyByZW1lbWJlciB3aGF0IHRoZSBjb2x1bW4gbmFtZXMgYXJlOgoKYGBge3IsIGV2YWw9Rn0KbmFtZXMocG9saWNlKQpgYGAKClJlY2FsbCwgdGhlIGBzZWxlY3RgIGZ1bmN0aW9uIHRha2VzIGFzIHRoZSBmaXJzdCBpbnB1dCBhIGRhdGEgZnJhbWUsIGFuZCB0aGVuIHdlIGNhbiBsaXN0IG9uZSBvciBtb3JlIGNvbHVtbnMsIG5hbWVzIHVucXVvdGVkLCB0aGF0IHdlIHdhbnQgdG8gc2VsZWN0LiBUaGUgY29sdW1ucyB3aWxsIGJlIG9yZGVyZWQgaW4gdGhlIG9yZGVyIHdlIHNwZWNpZnkgdGhlbS4gTm90aWNlIHRoYXQgdGhlIG9yZGVyIGluIHRoZSBvdXRwdXQgaXMgZGlmZmVyZW50IHRoYW4gdGhlIG9yaWdpbmFsIG9yZGVyIGFib3ZlLgoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3Qob3V0Y29tZSwgZGF0ZSkKc2VsZWN0KHBvbGljZSwgb3V0Y29tZSwgZGF0ZSkKYGBgCgoKIyMgUmFuZ2VzCgpUaGVyZSBhcmUgYSBudW1iZXIgb2Ygc2VsZWN0IGhlbHBlciBmdW5jdGlvbnMgYW5kIHNwZWNpYWwgc3ludGF4IG9wdGlvbnMgdGhhdCBhbGxvdyB1cyB0byBjaG9vc2UgbXVsdGlwbGUgY29sdW1ucy4KCkZpcnN0LCB3ZSBjYW4gdXNlIDogZm9yIHJhbmdlLCBidXQgd2l0aCBuYW1lcyBpbiBhZGRpdGlvbiB0byBudW1iZXJzOgoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3QocmF3X0RyaXZlclJhY2U6cmF3X1Jlc3VsdE9mU3RvcCkKYGBgCgpUaGUgcmVzdWx0IGlzIHRoZSBzYW1lIGlmIHdlIHVzZSBudW1iZXJzLgoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3QoMjY6MjkpCmBgYAoKCldlIGNhbiBzZWxlY3QgdGhlIHJpZ2h0bW9zdCBjb2x1bW5zIHdpdGggYGxhc3RfY29sKClgLiBZb3UgY2FuIGNoZWNrIHdpdGggYG5hbWVzYCB0aGF0IGl0IGlzIHRoZSAibGFzdCIgY29sdW1uIGluIG91ciBkYXRhc2V0LgoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3QobGFzdF9jb2woKSkKYGBgCgpZb3UgY2FuIHVzZSB0aGlzIHRvIGNvdW50IGNvbHVtbnMgZnJvbSB0aGUgcmlnaHQ6CgpgYGB7cn0Kc2VsZWN0KHBvbGljZSwgbGFzdF9jb2wob2Zmc2V0PTMpKQpgYGAKClRoaXMgaXMgb25lIG9mIHRoZSBmZXcgcGxhY2VzIFIgYWN0cyBsaWtlIGl0J3MgY291bnRpbmcgZnJvbSAwLCB0aGF0J3MgYmVjYXVzZSBpdCdzIHRoZSBudW1iZXIgb2YgY29sdW1ucyB0byBvZmZzZXQgZnJvbSB0aGUgZW5kOgoKYGBge3J9CiMgdGhlc2UgYXJlIHRoZSBzYW1lCnNlbGVjdChwb2xpY2UsIGxhc3RfY29sKDApKSAlPiUgbmFtZXMoKQpzZWxlY3QocG9saWNlLCBsYXN0X2NvbCgpKSAlPiUgbmFtZXMoKQpgYGAKCgojIyMgRVhFUkNJU0UKClNlbGVjdCBqdXN0IHRoZSBmaXJzdCA2IGNvbHVtbnMgb2YgcG9saWNlLgoKYGBge3J9CgpgYGAKCgojIyBFeGNsdWRpbmcgY29sdW1ucwoKV2UgY2FuIGFsc28gc2F5IHdoaWNoIGNvbHVtbnMgd2UgZG9uJ3Qgd2FudCBieSBwdXR0aW5nIGEgYC1gIChtaW51cykgaW4gZnJvbnQgb2YgdGhlIG5hbWUuIFRoaW5rIGFib3V0IGl0IGFzIHN1YnRyYWN0aW5nIG9uZSBvciBtb3JlIGNvbHVtbnMuIFRoZSBpZGVhIG9mIHN1YnRyYWN0aW5nIG1ha2VzIGEgbG90IG9mIHNlbnNlIC0tIGFmdGVyIHRoZSBjb21tYW5kIGJlbG93LCB3ZSBoYXZlIG5vdyAyNyByYXRoZXIgdGhhbiB0aGUgb3JpZ2luYWwgMjkgY29sdW1ucyBpbiB0aGUgZGF0YS4gCgpgYGB7ciwgZXZhbD1GfQpwb2xpY2UgJT4lIHNlbGVjdCgtcmF3X3Jvd19udW1iZXIsIC1zdWJqZWN0X2FnZSkKYGBgCgpXaGVuIHVzaW5nIG5lZ2F0ZWQgYC1gIGNvbHVtbiBuYW1lcywgaWYgd2Ugc3RhcnQgd2l0aCBuZWdhdGlvbnMgYW5kIHRyeSB0byBtaXggaW4gY29sdW1ucyB3ZSB3YW50IHRvIGtlZXAsIGl0IHdpbGwgZ2V0IG1lc3N5LiBNYWtlIHN1cmUgdG8gKmF2b2lkKiB0aGUgZm9sbG93aW5nIGNvZGU6CgpgYGB7ciwgZXZhbD1GfQpwb2xpY2UgJT4lIHNlbGVjdCgtcmF3X3Jvd19udW1iZXIsIC1zdWJqZWN0X2FnZSwgdGltZTpvdXRjb21lKSAKYGBgCgpUbyBib3RoIHNwZWNpZnkgdGhlIGNvbHVtbnMgd2FudGVkIGFuZCBleGNsdWRlIHNvbWUgdGhhdCB3b3VsZCBvdGhlcndpc2UgYmUgc2VsZWN0ZWQsIHRoZSBleGNsdXNpb25zIG5lZWQgdG8gY29tZSBhdCB0aGUgZW5kOgoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3QodGltZTpvdXRjb21lLCAtc3ViamVjdF9hZ2UpIApgYGAKCldlIGRvbid0IG5lZWQgdG8gaW5jbHVkZSAtcmF3X3Jvd19udW1iZXIgLS0gaXQgaXMgbm90IHBhcnQgb2YgdGhlIHJhbmdlIGJldHdlZW4gdGltZSBhbmQgb3V0Y29tZS4gSWYgd2UgZG8gaW5jbHVkZSBpdCwgd2Ugd2lsbCBzdGlsbCBnZXQgdGhlIHNhbWUgcmVzdWx0LiAgCgpgYGB7ciwgZXZhbD1GfQpwb2xpY2UgJT4lIHNlbGVjdCh0aW1lOm91dGNvbWUsIC1zdWJqZWN0X2FnZSwgLXJhd19yb3dfbnVtYmVyKSAKYGBgCgojIyMgRVhFUkNJU0UKCkRyb3AgdGhlIGxhc3QgNCBjb2x1bW5zIGZyb20gYHBvbGljZWAgKHRlbXBvcmFyaWx5IC0gd3JpdGUgYW4gZXhwcmVzc2lvbiB0aGF0IHdpbGwgZ2l2ZSB5b3UgcG9saWNlIHdpdGggdGhvc2UgY29sdW1ucyBub3QgaW5jbHVkZWQpLgoKYGBge3J9CgpgYGAKCgojIyBSZW9yZGVyaW5nIGFuZCByZW5hbWluZwoKV2UndmUgYWxyZWFkeSBzZWVuIHRoYXQgY29sdW1ucyB3aWxsIGFwcGVhciBpbiB0aGUgcmVzdWx0IGluIHRoZSBvcmRlciB0aGF0IHdlIGxpc3QgdGhlIG5hbWVzLiAgCgpJZiB3ZSBsaXN0IGEgY29sdW1uIG5hbWUgbW9yZSB0aGFuIG9uY2UsIGl0IHdpbGwgYXBwZWFyIGluIHRoZSBmaXJzdCBwb3NpdGlvbiBvbmx5IChpdCB3b24ndCBiZSByZXBlYXRlZCk6CgpgYGB7cn0Kc2VsZWN0KHBvbGljZSwgZGF0ZSwgdGltZSwgbG9jYXRpb24sIGRhdGUpCmBgYAoKCklmIHlvdSB3YW50IHRvIHB1bGwgYSBmZXcgY29sdW1ucyBvdmVyIHRvIHRoZSBsZWZ0IHNvIHRoYXQgdGhleSBhcmUgdGhlIG9uZXMgdGhhdCBzaG93IGZpcnN0IHdoZW4geW91IGxvb2sgYXQgdGhlIGRhdGEsIHRoZSBldmVyeXRoaW5nKCkgaGVscGVyIGZ1bmN0aW9uIGNhbiBiZSB1c2VmdWwuIAoKCmBgYHtyLCBldmFsPUZ9CnNlbGVjdChwb2xpY2UsIG91dGNvbWUsIGV2ZXJ5dGhpbmcoKSkKYGBgCgpXZSBjYW4gYWxzbyByZW5hbWUgY29sdW1ucyB3aGlsZSB1c2luZyBgc2VsZWN0KClgLiAgVGhlIHN5bnRheCBpcyBgbmV3X25hbWUgPSBvbGRfbmFtZWAuCgpgYGB7ciwgZXZhbD1GfQpwb2xpY2UgJT4lIHNlbGVjdChyYXdfaWQ9cmF3X3Jvd19udW1iZXIsIGRhdGUsIHRpbWUpCmBgYAoKb3Igd2UgY2FuIHVzZSBgcmVuYW1lKClgIHRvIG9ubHkgcmVuYW1lLCB3aXRob3V0IGFmZmVjdGluZyB3aGljaCBjb2x1bW5zIGFyZSBpbmNsdWRlZCBvciB0aGVpciBvcmRlciAoYWxsIG9mIHRoZSBjb2x1bW5zIGFyZSBrZXB0IGluIHRoZSBzYW1lIG9yZGVyKToKCmBgYHtyLCBldmFsPUZ9CnBvbGljZSAlPiUgcmVuYW1lKHJhd19pZD1yYXdfcm93X251bWJlcikKYGBgCgpSZW1lbWJlciwgdGhpcyBkb2Vzbid0IGNoYW5nZSBwb2xpY2UgYmVjYXVzZSB3ZSBkaWRuJ3Qgc2F2ZSB0aGUgcmVzdWx0LiAgU28gZmFyLCB3ZSd2ZSBqdXN0IGJlZW4gcHJpbnRpbmcgdGhlIGNvcHkgb2YgdGhlIGRhdGEgZnJhbWUgdGhhdCBpcyByZXR1cm5lZCBieSB0aGUgZnVuY3Rpb24uICBJZiB3ZSB3YW50IHRvIGNoYW5nZSBvdXIgZGF0YSBmcmFtZSwgd2UnZCBuZWVkIHRvIHNhdmUgdGhlIHJlc3VsdCBiYWNrIHRvIHRoZSBgcG9saWNlYCBvYmplY3QuIFdlIGNhbiBhbHNvIHNhdmUgdGhlIGNoYW5nZXMgaW4gYW5vdGhlciBvYmplY3Qgd2l0aCBhIGRpZmZlcmVudCBuYW1lIHN1Y2ggYXMgYHBvbGljZV9uZXdgLgoKCiMjIyBFWEVSQ0lTRVMKClJlbWVtYmVyOiBydW4gdGhlIGNlbGxzIGFib3ZlIHRvIGxvYWQgdGlkeXZlcnNlIGFuZCBpbXBvcnQgdGhlIGRhdGEuCgpVc2luZyBgc2VsZWN0YCBhbmQvb3IgYHJlbmFtZWAgYXMgbmVlZGVkOgoKLSBSZW5hbWUgc3ViamVjdF9hZ2UgdG8gYWdlLCBzdWJqZWN0X3JhY2UgdG8gcmFjZSwgYW5kIHN1YmplY3Rfc2V4IHRvIHNleCwgYnV0IGtlZXAgdGhlIGNvbHVtbnMgaW4gdGhlaXIgb3JpZ2luYWwgb3JkZXIKLSBFeGNsdWRlIHRoZSBkZXBhcnRtZW50X2lkIGFuZCBkZXBhcnRtZW50X25hbWUgY29sdW1ucwoKSGludDogCgotIFJlbWVtYmVyIHRoYXQgeW91IGNhbiBjaGFpbiBkcGx5ciBjb21tYW5kcyB0b2dldGhlciB3aXRoIGAlPiVgCi0gWW91IGRvbid0IG5lZWQgdG8gc2F2ZSB0aGUgcmVzdWx0cyBpbiBhIG5ldyB2YXJpYWJsZQoKCmBgYHtyfQoKYGBgCgoKCiMjIE1hdGNoaW5nIG5hbWVzCgoKV2UgY2FuIGFsc28gc2VsZWN0IGJ5IG1hdGNoaW5nIHBhdHRlcm5zIGluIHRoZSBuYW1lcyBvZiB0aGUgY29sdW1ucy4gIFRoZSBwYXR0ZXJucyB0byBtYXRjaCBhcmUgaW4gcXVvdGVzIGJlY2F1c2UgdGhleSBhcmVuJ3QgY29sdW1uIG5hbWVzIC0tIGp1c3QgY2hhcmFjdGVyIGRhdGEuCgpgYGB7ciwgZXZhbD1GfQpwb2xpY2UgJT4lIHNlbGVjdChzdGFydHNfd2l0aCgiY29udHJhYmFuZCIpKQpgYGAKCmBgYHtyLCBldmFsPUZ9CnBvbGljZSAlPiUgc2VsZWN0KGVuZHNfd2l0aCgiaXNzdWVkIikpCmBgYAoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3QoY29udGFpbnMoInZlaGljbGUiKSkKYGBgCgpXZSBjYW4gYWxzbyBwdXQgYSBgLWAgaW4gZnJvbnQgb2YgdGhlc2UgaGVscGVyIGZ1bmN0aW9ucyB0byBleGNsdWRlIGNvbHVtbnM6CgpgYGB7ciwgZXZhbD1GfQpwb2xpY2UgJT4lIHNlbGVjdCgtY29udGFpbnMoInN1YmplY3QiKSkKYGBgCgoKQW5kIHRoZXJlIGFyZSBldmVuIG1vcmUgW3NlbGVjdCBoZWxwZXIgZnVuY3Rpb25zXShodHRwczovL3RpZHlzZWxlY3Quci1saWIub3JnL3JlZmVyZW5jZS9sYW5ndWFnZS5odG1sKS4gIAoKIyMjIEVYRVJDSVNFCgpVc2UgYHNlbGVjdCgpYCB0byBnZXQgYSBjb3B5IG9mIGBwb2xpY2VgIHdpdGhvdXQgdGhlIGNvbHVtbnMgdGhhdCBzdGFydCB3aXRoICJyYXciLiAgCgpJbiBvdGhlciB3b3JkcywgZHJvcCB0aGUgY29sdW1ucyB0aGF0IHN0YXJ0IHdpdGggInJhdyIsIGV4Y2VwdCAxKSBkb24ndCBwZXJtYW5lbnRseSBjaGFuZ2UgYHBvbGljZWAgYW5kIDIpIGluc3RlYWQgb2YgZHJvcHBpbmcsIHdlJ3JlIHJlYWxseSBzZWxlY3Rpbmcgd2hhdCB3ZSB3YW50IHRvIGtlZXAgaW5zdGVhZC4KCgpgYGB7ciwgfQoKYGBgCgoKIyMgU2VsZWN0aW5nIHdpdGggVmVjdG9ycyBvciBGdW5jdGlvbnMKCldoYXQgaWYgd2UgaGF2ZSB0aGUgbmFtZXMgb2YgdGhlIGNvbHVtbnMgd2Ugd2FudCB0byBzZWxlY3QgaW4gYSB2ZWN0b3IgYWxyZWFkeT8gIEZvciBleGFtcGxlOgoKYGBge3IsIGV2YWw9VFJVRX0KYW5hbHlzaXNfdmFycyA8LSBjKCJzZWFyY2hfYmFzaXMiLCAicmVhc29uX2Zvcl9zdG9wIikKYGBgCgpQZXJoYXBzIHdlIGJ1aWx0IHRoaXMgdmVjdG9yIHByb2dyYW1hdGljYWxseSAod2Ugd3JvdGUgY29kZSB0byBkZXRlcm1pbmUgdGhlIHZhbHVlcywgaW5zdGVhZCBvZiB0eXBpbmcgdGhlbSBvdXJzZWx2ZXMpLCBzbyB3ZSBjYW4ndCBqdXN0IHJld3JpdGUgaXQgdG86IAoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3Qoc2VhcmNoX2Jhc2lzLCByZWFzb25fZm9yX3N0b3ApCmBgYAoKSWYgd2UganVzdCBnaXZlIHRoZSB2ZWN0b3IgdG8gYHNlbGVjdGAsIGl0IGxvb2tzIGxpa2Ugd2UgZXhwZWN0ICJhbmFseXNpc192YXJzIiB0byBiZSBhIGNvbHVtbiBuYW1lIGluIHBvbGljZS4gIFdlIGdldCBhIHdhcm5pbmc6CgpgYGB7cn0KcG9saWNlICU+JSBzZWxlY3QoYW5hbHlzaXNfdmFycykKYGBgCgpUaGlzIHdhcm5pbmcgdGVsbHMgdXMgd2hhdCB3ZSBzaG91bGQgZG8gaW5zdGVhZCwgd2hpY2ggaXMgdXNlIGBhbGxfb2ZgOgoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3QoYWxsX29mKGFuYWx5c2lzX3ZhcnMpKQpgYGAKClRoaXMgbWFrZXMgaXQgY2xlYXJlciB0aGF0ICJhbmFseXNpc192YXJzIiBpc24ndCB0aGUgbmFtZSBvZiBhIGNvbHVtbiBpbiBwb2xpY2UuCgpXaGF0IGlmIHdlIHdhbnQgdG8gc2VsZWN0IGNvbHVtbnMgb2YgYSBjZXJ0YWluIHR5cGUgLS0gZm9yIGV4YW1wbGUsIG9ubHkgdGhlIG51bWVyaWMgY29sdW1ucz8gIAoKYGBge3IsIGV2YWw9Rn0KcG9saWNlICU+JSBzZWxlY3Qod2hlcmUoaXMubnVtZXJpYykpCmBgYAoKYGlzLm51bWVyaWNgIGlzIHRoZSBuYW1lIG9mIGEgZnVuY3Rpb24uICBXZSBqdXN0IHVzZSB0aGUgbmFtZSB3aXRob3V0IGAoKWAuICBUaGlzIGZ1bmN0aW9uIGlzIGFwcGxpZWQgdG8gZWFjaCBjb2x1bW4sIGFuZCBpZiBpdCByZXR1cm5zIFRSVUUsIHRoZW4gdGhlIGNvbHVtbiBpcyBzZWxlY3RlZC4gIExpa2UgYWJvdmUgd2l0aCB1c2luZyBhIHZlY3Rvciwgd2Ugd3JhcCB0aGUgZnVuY3Rpb24gd2Ugd2FudCB0byB1c2UgaW4gYHdoZXJlYCB0byBtYWtlIGl0IGNsZWFyIHRoYXQgd2UncmUgdXNpbmcgYSBmdW5jdGlvbiwgbm90IGxvb2tpbmcgZm9yIGEgY29sdW1uIG5hbWVkICJpcy5udW1lcmljIikuICAKCmB3aGVyZWAgY2FuIGJlIHVzZWQgd2l0aCBhbnkgZnVuY3Rpb24gdGhhdCByZXR1cm5zIGEgKnNpbmdsZSogVFJVRSBvciBGQUxTRSB2YWx1ZSBmb3IgZWFjaCBjb2x1bW4uICAKCiMjIyBFWEVSQ0lTRSAKClNlbGVjdCBjb2x1bW5zIHdpdGggbG9naWNhbCAoVFJVRS9GQUxTRSkgZGF0YSBmcm9tIHBvbGljZToKCmBgYHtyfQoKYGBgCgojIyBDb21iaW5pbmcgbXVsdGlwbGUgc2VsZWN0IGNvbmRpdGlvbnMKCldoYXQgaWYgd2Ugd2FudCB0byBjb21iaW5lIG11bHRpcGxlIHNlbGVjdCBjb25kaXRpb25zPyAgRm9yIGV4YW1wbGUsIHNlbGVjdCBjb2x1bW5zIGZyb20gcG9saWNlIHRoYXQgY29udGFpbiAidmVoaWNsZSIgYW5kIGFyZSBjaGFyYWN0ZXIgZGF0YT8KCldlIGNhbiB1c2UgJiBhbmQgfAoKYGBge3J9CnNlbGVjdChwb2xpY2UsIGNvbnRhaW5zKCJ2ZWhpY2xlIikpCnNlbGVjdChwb2xpY2UsIGNvbnRhaW5zKCJ2ZWhpY2xlIikgJiB3aGVyZShpcy5jaGFyYWN0ZXIpKQpgYGAKCgoKIyBGaWx0ZXI6IENob29zZSBSb3dzCgpUaGUgYGZpbHRlcigpYCBmdW5jdGlvbiBsZXRzIHVzIGNob29zZSB3aGljaCByb3dzIG9mIGRhdGEgdG8ga2VlcCBieSB3cml0aW5nIGV4cHJlc3Npb25zIHRoYXQgcmV0dXJuIFRSVUUgb3IgRkFMU0UgZm9yIGV2ZXJ5IHJvdyBpbiB0aGUgZGF0YSBmcmFtZS4gIFJlY2FsbDoKCmBgYHtyLCBldmFsPUZ9CnBvbGljZSAlPiUgIGZpbHRlcihkYXRlID09ICIyMDE3LTAxLTAyIikKZmlsdGVyKHBvbGljZSwgZGF0ZSA9PSAiMjAxNy0wMS0wMiIpCmBgYAoKV2UgY2FuIGRvIGNvbXBsZXggY29uZGl0aW9ucyBhcyB3ZSBjb3VsZCBkbyB3aXRoIGBbXWAKCmBgYHtyLCBldmFsPUZ9CnBvbGljZSAlPiUgZmlsdGVyKHN1YmplY3RfcmFjZSA9PSAiaGlzcGFuaWMiICYgc3ViamVjdF9zZXggPT0gImZlbWFsZSIpCmBgYAoKSWYgd2UgaW5jbHVkZSBtdWx0aXBsZSBjb21tYS1zZXBhcmF0ZWQgY29uZGl0aW9ucywgdGhleSBhcmUgam9pbmVkIHdpdGggYCZgIChhbmQpLiAgU28gdGhpcyBmb2xsb3dpbmcgaXMgZXF1aXZhbGVudCB0byB0aGUgYWJvdmUuCgpgYGB7ciwgZXZhbD1GfQpwb2xpY2UgJT4lIGZpbHRlcihzdWJqZWN0X3JhY2UgPT0gImhpc3BhbmljIiwgc3ViamVjdF9zZXggPT0gImZlbWFsZSIpCmBgYAoKCiMjIyBFWEVSQ0lTRVMKCjEuIEZpbHRlciBgcG9saWNlYCB0byBjaG9vc2UgdGhlIHJvd3Mgd2hlcmUgbG9jYXRpb24gaXMgNjAyMDEgb3IgNjAyMDIKMi4gRmlsdGVyIGBwb2xpY2VgIHRvIGNob29zZSB0aGUgcm93cyB3aGVyZSBsb2NhdGlvbiBpcyA2MDIwMSBvciA2MDIwMiwgYW5kIHN1YmplY3Rfc2V4IGlzICJtYWxlIgoKSGludHM6CgoqIFRoZSAib3IiIG9wZXJhdG9yIGlzIGB8YDsgdGhlICJhbmQiIG9wZXJhdG9yIGlzIGAmYAoKYGBge3J9CgpgYGAKCiMjIEluY2x1ZGluZyBWYXJpYWJsZSBUcmFuc2Zvcm1hdGlvbnMKCldoZW4gZmlsdGVyaW5nLCB3ZSBjYW4gaW5jbHVkZSB0cmFuc2Zvcm1hdGlvbnMgb2YgdmFyaWFibGVzIGluIG91ciBleHByZXNzaW9ucy4gIFRvIHNlZSB0aGlzLCB3ZSdsbCB1c2UgdGhlIGJ1aWx0LWluIGBtdGNhcnNgIGRhdGFzZXQuCgpIZXJlJ3Mgd2hhdCBgbXRjYXJzYCBsb29rcyBsaWtlOgoKYGBge3J9Cm10Y2FycwpgYGAKCk5vdywgbGV0J3MgZmlsdGVyIHRvIHNlZSB3aGljaCBjYXJzIGhhdmUgYWJvdmUgYXZlcmFnZSBtcGc6CgpgYGB7ciwgZXZhbD1GfQptdGNhcnMgJT4lIGZpbHRlcihtcGcgPiBtZWFuKG1wZykpCmBgYAoKT3Igd2hpY2ggY2FyIGhhcyB0aGUgbW9zdCBob3JzZXBvd2VyIChocCk6CgpgYGB7ciwgIGV2YWw9Rn0KbXRjYXJzICU+JSBmaWx0ZXIoaHAgPT0gbWF4KGhwKSkKYGBgCgoKIyMjIEVYRVJDSVNFUwoKVXNpbmcgYG10Y2Fyc2AsIGZpbmQgdGhlIGNhciB3aXRoIHRoZSBtaW5pbXVtIChgbWluKClgKSBkaXNwbGFjZW1lbnQgKGRpc3ApIHZhbHVlOgoKYGBge3J9CgpgYGAKCkZpbmQgY2FycyB0aGF0IGRvIG5vdCBoYXZlIHRoZSBtZWRpYW4gbnVtYmVyIG9mIGN5bGluZGVycy4gIAoKYGBge3J9CgpgYGAKCgojIyBFWEVSQ0lTRQoKVXNpbmcgYHBvbGljZWA6IGZpbmQgb2JzZXJ2YXRpb25zIHRoYXQgYXJlIG5vdCBtb3ZpbmcgdmlvbGF0aW9ucy4gIFRoZSB2aW9sYXRpb24gdmFyaWFibGUgaGFzIGEgZmV3IGNhdGVnb3JpZXMuICBUYWtlIGEgbG9vazoKCmBgYHtyfQp0YWJsZShwb2xpY2UkdmlvbGF0aW9uKQpgYGAKCldyaXRlIGNvZGUgdG8gZmluZCBzdG9wcyB0aGF0IGRvbid0IHN0YXJ0IHdpdGggIk1vdmluZyBWaW9sYXRpb24iLiAgCgpzdHJfZGV0ZWN0KCkgaXMgYSB1c2VmdWwgZnVuY3Rpb24gZm9yIHRoaXMuICBFeGFtcGxlOgoKYGBge3J9CnBvbGljZSAlPiUKICBmaWx0ZXIoc3RyX2RldGVjdChzdWJqZWN0X3JhY2UsICJ3IikpCmBgYAoKTm93IGZpbmQgdGhlIHN0b3BzIHRoYXQgYXJlIE5PVCBtb3ZpbmcgdmlvbGF0aW9uczoKCmBgYHtyfQoKYGBgCgoKCiMgQm9udXM6IHNsaWNlIHZhcmlhbnRzCgpMYXN0IHNlc3Npb24sIHdlIHNhdyBgc2xpY2UoKWAgYnJpZWZseSBhcyBhIHdheSB0byBjaG9vc2Ugd2hpY2ggcm93cyB3ZSB3YW50IGJ5IHRoZWlyIGludGVnZXIgaW5kZXggdmFsdWUuICBCdXQsIHRoZXJlIGFyZSBzb21lIHVzZWZ1bCB2YXJpYW50cyBvbiB0aGUgYHNsaWNlYCBmdW5jdGlvbiB0aGF0IGhlbHAgdXMgc2VsZWN0IHJvd3MgdGhhdCBoYXZlIHRoZSBtYXhpbXVtIG9yIG1pbmltdW0gdmFsdWUgb2YgYSBwYXJ0aWN1bGFyIHZhcmlhYmxlOgoKYGBge3IsIGV2YWw9VFJVRX0KbXRjYXJzICU+JSBzbGljZV9tYXgoaHApCnNsaWNlX21heChtdGNhcnMsIGhwKQpgYGAKCkJ5IGRlZmF1bHQgaXQganVzdCBnaXZlcyB1cyBvbmUgbWF4aW11bSB2YWx1ZSAoYWxsIHJvd3MgdGhhdCBoYXZlIHRoYXQgdmFsdWUgdGhvdWdoKSwgYnV0IHdlIGNhbiBhc2sgZm9yIG1vcmUgdGhhbiBvbmUgaGlnaGVzdCB2YWx1ZSBieSBzZXR0aW5nIHRoZSBgbmAgYXJndW1lbnQ6CgpgYGB7ciwgZXZhbD1UUlVFfQpzbGljZV9tYXgobXRjYXJzLCBocCwgbj0zKQpgYGAKCldlIGdvdCA0IHJvd3MgYWJvdmUgYmVjYXVzZSB0aGVyZSB3YXMgYSB0aWUgYXQgcG9zaXRpb24gMy4gIFRoZXJlJ3MgYW4gb3B0aW9uIGB3aXRoX3RpZXNgIHRoYXQgY2FuIGNoYW5nZSBob3cgdGllcyBhcmUgaGFuZGxlZC4gIAoKVGhlcmUncyBhbHNvIGEgbWluaW11bSB2ZXJzaW9uOgoKYGBge3IsIGV2YWw9VFJVRX0Kc2xpY2VfbWluKG10Y2FycywgZGlzcCkKYGBgCgpMaWtlIHdlIGRpZCB3aXRoIGBzbGljZV9tYXhgLCB5b3UgY2FuIGFsc28gc3BlY2lmeSB0aGUgYG5gIGFyZ3VtZW50LgoKIyMgRVhFUkNJU0UKCkZpbmQgdGhlIDIgY2FycyB3aXRoIHRoZSBiZXN0IG1wZyB2YWx1ZXMgaW4gbXRjYXJzIChoaWdoIHZhbHVlcyBhcmUgYmV0dGVyKS4KClRoZW4sIGxvb2tpbmcgb25seSBhdCBjYXJzIHdpdGggNCBjeWxpbmRlcnMsIGZpbmQgdGhlIDIgd2l0aCB0aGUgYmVzdCBtcGcgdmFsdWVzLgoKYGBge3J9CgpgYGAKCgojIE11dGF0ZTogQ2hhbmdlIG9yIENyZWF0ZSBDb2x1bW5zCgpgbXV0YXRlKClgIGlzIHVzZWQgdG8gYm90aCBjaGFuZ2UgdGhlIHZhbHVlcyBvZiBhbiBleGlzdGluZyBjb2x1bW4gYW5kIG1ha2UgYSBuZXcgY29sdW1uLiAgCgpXZSBuYW1lIHRoZSBjb2x1bW4gd2UncmUgbXV0YXRpbmcgYW5kIHNldCB0aGUgdmFsdWUuICBJZiB0aGUgbmFtZSBhbHJlYWR5IGV4aXN0cywgaXQgd2lsbCB1cGRhdGUgdGhlIGNvbHVtbi4gSWYgdGhlIG5hbWUgZG9lc24ndCBleGlzdCwgaXQgd2lsbCBjcmVhdGUgYSBuZXcgdmFyaWFibGUgKGNvbHVtbiBpcyBhcHBlbmRlZCBhdCB0aGUgZW5kIG9mIGV4aXN0aW5nIGNvbHVtbnMpLiAgCgpgYGB7ciwgZXZhbD1UUlVFfQpwb2xpY2UgJT4lIAogIG11dGF0ZSh2ZWhpY2xlX2FnZSA9IDIwMTcgLSB2ZWhpY2xlX3llYXIpICU+JQogIHNlbGVjdChzdGFydHNfd2l0aCgidmVoaWNsZSIpKSAgIyBqdXN0IHRvIHBpY2sgYSBmZXcgY29sdW1ucyB0byBsb29rIGF0CmBgYAoKV2UgY2FuIHB1dCBtdWx0aXBsZSBtdXRhdGlvbnMgaW4gdGhlIHNhbWUgY2FsbCB0byBtdXRhdGUsIHdpdGggdGhlIGV4cHJlc3Npb25zIHNlcGFyYXRlZCBieSBjb21tYXM6CgpgYGB7ciwgIGV2YWw9VFJVRX0KbXV0YXRlKHBvbGljZSwgCiAgICAgICB2ZWhpY2xlX2FnZSA9IDIwMTcgLSB2ZWhpY2xlX3llYXIsCiAgICAgICBvbGRfY2FyID0gdmVoaWNsZV95ZWFyIDwgMjAwMCkKYGBgCgoKV2l0aGluIGEgY2FsbCB0byBtdXRhdGUsIHdlIGNhbiByZWZlciB0byB2YXJpYWJsZXMgd2UgbWFkZSBvciBjaGFuZ2VkIGVhcmxpZXIgaW4gdGhlIHNhbWUgY2FsbCBhcyB3ZWxsLiAgSGVyZSwgd2UgY3JlYXRlIHZlaGljbGVfYWdlLCBhbmQgdGhlbiB1c2UgaXQgdG8gY3JlYXRlIHZlaGljbGVfYWdlX25vcm06CgpgYGB7ciwgZXZhbD1UUlVFfQpwb2xpY2UgJT4lIAogIG11dGF0ZSh2ZWhpY2xlX2FnZSA9IDIwMTcgLSB2ZWhpY2xlX3llYXIsIAogICAgICAgICB2ZWhpY2xlX2FnZV9ub3JtID0gaWZlbHNlKHZlaGljbGVfYWdlIDwgMCwgICMgaWZlbHNlIHRlc3QgY29uZGl0aW9uCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMCwgICMgdmFsdWUgaWYgdHJ1ZQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHZlaGljbGVfYWdlKSAgIyB2YWx1ZSBpZiBmYWxzZQogICAgICAgICApICU+JSAgCiAgIyBiZWxvdyBpcyBqdXN0IG1ha2luZyBpdCBlYXNpZXIgZm9yIHVzIHRvIHNlZSB3aGF0IHdlIGNoYW5nZWQKICBzZWxlY3Qoc3RhcnRzX3dpdGgoInZlaGljbGUiKSkgJT4lCiAgZmlsdGVyKHZlaGljbGVfYWdlIDwgMCkKYGBgCgpTaWRlIG5vdGU6IHRoZXJlIGlzIGEgdGlkeXZlcnNlIHZlcnNpb24gb2YgYGlmZWxzZSgpYCBjYWxsZWQgYGlmX2Vsc2UoKWAgLS0gd2l0aCB0aGUgdW5kZXJzY29yZSBvciBsb3cgZGFzaCBzeW1ib2wgLS0gdGhhdCB3b3JrcyBnZW5lcmFsbHkgdGhlIHNhbWUgZXhjZXB0IGl0IGlzIHN0cmljdGVyIGFib3V0IGNoZWNraW5nIGRhdGEgdHlwZXMuCgpgbXV0YXRlKClgIGNhbiBhbHNvIGNoYW5nZSBhbiBleGlzdGluZyBjb2x1bW4uICBJdCB3aWxsIG92ZXJ3cml0ZSBpdC4KCgpgYGB7ciwgZXZhbD1UUlVFfQpwb2xpY2UgJT4lCiAgbXV0YXRlKGRlcGFydG1lbnRfaWQgPSAiRVBEIikKYGBgCgpXZSBkaWRuJ3Qgc2F2ZSB0aGUgb3V0cHV0LCBzbyB0aGUgY29sdW1uIGhhc24ndCBjaGFuZ2VkIHBlcm1hbmVudGx5IC0gb25seSBpbiB0aGUgb3V0cHV0LgoKYGBge3J9CnBvbGljZQpgYGAKCgpSZW1lbWJlciB0aGF0IHdoZW4gdXNpbmcgYG11dGF0ZSgpYCwgeW91J3JlIG9wZXJhdGluZyBvbiB0aGUgZW50aXJlIGNvbHVtbiBhdCBvbmNlLCBzbyB5b3UgY2FuJ3Qgc2VsZWN0IGp1c3QgYSBzdWJzZXQgb2YgdGhlIHZlY3RvciBhcyB5b3Ugd291bGQgd2l0aCBgW11gLiAgVGhpcyBtZWFucyBtb3JlIGZyZXF1ZW50bHkgdXNpbmcgZnVuY3Rpb25zIGxpa2UgYGlmZWxzZSgpYCBvciBoZWxwZXIgZnVuY3Rpb25zIHN1Y2ggYXMgYG5hX2lmKClgLCBgcmVwbGFjZV9uYSgpYCwgb3IgYHJlY29kZSgpYC4gIAoKYG5hX2lmYCByZXBsYWNlcyBhbiBleGlzdGluZyB2YWx1ZSB3aXRoIGBOQWAuICBgcmVwbGFjZV9uYWAgZG9lcyByb3VnaGx5IHRoZSBvcHBvc2l0ZTogcmVwbGFjZXMgYE5BYCB3aXRoIGEgbmV3IHZhbHVlLgoKYGBge3J9CnBvbGljZSAlPiUgbXV0YXRlKHZlaGljbGVfbWFrZSA9IG5hX2lmKHZlaGljbGVfbWFrZSwgIlVOSyIpKQpgYGAKCmBuYV9pZigpYCBjYW4gb25seSBjYW4gY2hlY2sgYW5kIHJlcGxhY2Ugb25lIHZhbHVlIGF0IGEgdGltZTsgaXQgYWxzbyBjYW4ndCBiZSB1c2VkIHdpdGggYW55IGV4cHJlc3Npb25zIChgeCA8PSAxYCkgLS0gb25seSBzaW5nbGUgdmFsdWVzLgoKCiMjIyBFWEVSQ0lTRQoKSWYgdGhlIGNvbHVtbiBiZWF0IGluIGBwb2xpY2VgIGlzICIvIiBvciAiQ0hJQ0FHTyIsIHNldCBpdCB0byBgTkFgIGluc3RlYWQgdXNpbmcgYG11dGF0ZSgpYC4gIAoKSGludDogaXQncyBvayBpZiB5b3UgdGFrZSB0d28gc3RlcHMgdG8gZG8gdGhpcy4gICAgCgpgYGB7cn0KYGBgCgoKCiMgUmVjYXAKCllvdSBub3cgY2FuIHVzZSBgc2VsZWN0YCBhbmQgYGZpbHRlcmAgdG8gc3Vic2V0IHlvdXIgZGF0YSBpbiBhIHdpZGUgdmFyaWV0eSBvZiB3YXlzLCBhbmQgYG11dGF0ZWAgdG8gdXBkYXRlIHZhcmlhYmxlcyBvciBjcmVhdGUgbmV3IG9uZXMuICAKCk5leHQgc2Vzc2lvbjogdGhlIHRocmVlIG90aGVyIGNvbW1vbiBkcGx5ciAidmVyYiIgZnVuY3Rpb25zIGZvciB3b3JraW5nIHdpdGggZGF0YSBmcmFtZXM6IGBncm91cF9ieWAsIGBzdW1tYXJpemVgLCBhbmQgYGFycmFuZ2VgLiAgCgo=